Modeling Dynamic Patterns for Emotional Content in Music

نویسندگان

  • Yonatan Vaizman
  • Roni Y. Granot
  • Gert R. G. Lanckriet
چکیده

Emotional content is a major component in music. It has long been a research topic of interest to discover the acoustic patterns in the music that carry that emotional information, and enable performers to communicate emotional messages to listeners. Previous works looked in the audio signal for local cues, most of which assume monophonic music, and their statistics over time. Here, we used generic audio features, that can be calculated for any audio signal, and focused on the progression of these features through time, investigating how informative the dynamics of the audio is for emotional content. Our data is comprised of piano and vocal improvisations of musically trained performers, instructed to convey 4 categorical emotions. We applied Dynamic Texture Mixture (DTM), that models both the instantaneous sound qualities and their dynamics, and demonstrated the strength of the model. We further showed that once taking the dynamics into account even highly reduced versions of the generic audio features carry a substantial amount of information about the emotional content. Finally, we demonstrate how interpreting the parameters of the trained models can yield interesting cognitive suggestions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

بررسی الکتروانسفالوگرام شبکه موثر مغز انسان در حین گوش دادن به موسیقی به منظور تشخیص احساسات

In the current research brain effective networks related to happy and sad emotions are studied during listening to music. Connectivity patterns among different EEG channels were extracted using multivariate autoregressive modeling and partial directed coherence while participants listened to musical excerpts. Both classical and Iranian musical selections were used as stimulus. Participants’ se...

متن کامل

Emotional effects of dynamic textures

This study explores the effects of various spatiotemporal dynamic texture characteristics on human emotions. The emotional experience of auditory (eg, music) and haptic repetitive patterns has been studied extensively. In contrast, the emotional experience of visual dynamic textures is still largely unknown, despite their natural ubiquity and increasing use in digital media. Participants watche...

متن کامل

Computational Modeling of Emotional Content in Music

We present a system designed to model characteristics which contribute to the emotional content of music. It creates n-gram models, Hidden Markov Models, and entropy-based models from corpora of musical selections representing various emotions. These models can be used both to identify emotional content and generate pieces representative of a target emotion. According to survey results, generat...

متن کامل

تجزیه و تحلیل احساسات افراد از طریق سیگنال های مغزی با استفاده از تابع نگاشت پوانکاره

Introduction: Dynamic alterations of the brain are of high significance when it comes to analyze the human feelings. In this study, the hidden patterns corresponding for the emotional states have been investigated by adopting a certain Poincare’ map function inspired by the theory of chaos. The present study aimed to explore the significance relationship between the proposed methodology and the...

متن کامل

Re-scoring the Game’s Score: Dynamic Music, Personality and Immersion in the Ludonarrative

This study explores immersive presence as well as emotional valence and arousal in the context of dynamic and non-dynamic music scores in the 3 person action-adventure video game genre while also considering relevant personality traits of the player. 60 subjects answered self-report questionnaires of experiential states each time after playing the game 'Batman: Arkham City' in one of three rand...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011